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(54) Multi-way cache apparatus and method 

(57) Apparatus having a multi-way cache (18), the 
apparatus including a first user controllable element 
(102, 104, or 106) having a predetermined first attribute 
corresponding to a first way of the multi-way cache; a 
second user controllable element (102, 104, or 106) 
having a predetermined second attribute corresponding 
to a second way of the multi-way cache; a conductor 
(87) for transferring an access attribute to the multi-way 
cache; first compare circuitry (60) which compares the 
access attribute to the predetermined first attribute to 
provide a first comparison result; second compare cir- 
cuitry (60) which compares the access attribute to the 
predetermined second attribute to provide a second 
comparison result; first way control circuitry (92) for 
selectively enabling the first way of the multi-way cache 
based on the first comparison result; and second way 
control circuitry (92) for selectively enabling the second 
way of the multi-way cache based on the second com- 
parison result. 
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Description 

Field of the Invention 

[0001 ] The present invention relates generally to proc- 
essors and memory, and more particularly to multi-way 
cache memory. 

Background of the Invention 

[0002] Lower power consumption has been gaining 
importance in microprocessor and microcontroller 
design due to wide spread use of portable and hand- 
held applications. A typical embedded control system 
will generally include a central processing unit (CPU) 
and a variety of different types of memory and periph- 
eral devices. The different types of memory may be 
external to an integrated circuit having the microcontrol- 
ler, and/or on the same integrated circuit, and may 
include cache memory, ROM (read only memory), and a 
variety of SRAM (static random access memory) 
devices. 

[0003] A significant amount of energy and time is 
required to access a large external main memory. 
Therefore, a smaller, faster, and more efficient memory, 
sometimes referred to as a cache, may be used on the 
integrated circuit to reduce the number of accesses to 
the main memory. To keep the size of the integrated cir- 
cuit as small as possible, only as much memory as is 
necessary is included onboard the integrated circuit. 
[0004] A cache TAG is frequently used to increase the 
performance of the cache. The cache TAG receives a 
TAG address that is provided by the microprocessor and 
determines if the requested instructions and/or data are 
present in the cache memory. If a requested instruction 
is not located in the cache, the microprocessor must 
then retrieve the instruction from the main memory. 
When an instruction is written into the cache, the higher 
order bits of the address of the instruction are stored in 
a TAG array. The cache TAG also has a comparator that 
compares a processor generated address to the TAG 
address. If the TAG address and the processor gener- 
ated address are the same, a cache "hit" occurs, and a 
match signal is provided by the cache TAG, indicating 
that the requested data is located in the cache memory. 
If the processor generated address and the TAG 
address are not the same, a cache "miss" occurs, and 
the match signal indicates that the requested data is not 
located in the cache memory. In addition, a valid bit may 
be set as a part of the TAG address for qualifying a valid 
hit of the stored TAG address during a compare cycle of 
the cache. 

[0005] With conventional cache approaches, in many 
applications, cache efficiency may be negatively 
affected by conflicting access requirements leading to 
many cache misses and external memory accesses. In 
addition, in low power applications, a premium is placed 
on efficient power management for processing 



resources. It would be desirable for a cache memory to 
provide increased processing efficiency, e.g. higher 
cache hit rates, combined with lower power consump- 
tion. 

5 [0006] Accordingly, there is a need for an improved 
cache apparatus and method. 

Brief Description of the Drawings 

w [0007] While the invention is pointed out with particu- 
larity in the appended claims, other features of the 
invention are disclosed by the following detailed 
description taken in conjunction with the accompanying 
drawings, in which: 

15 

FIG. 1 is a block diagram of an embodiment of a 
data processing system. 

FIG. 2 is a block diagram of an embodiment of a 
20 portion of the cache of FIG. 1 . 

FIG. 3 is block diagram of a particular embodiment 
that more specifically illustrates the cache of FIG. 2. 

25 FIG. 4 is a general diagram that illustrating a partic- 
ular embodiment of the register for use in connec- 
tion with the cache of FIG. 2. 

FIG. 5 is a flow chart that illustrates access opera- 
30 tion of the cache of FIG 2 using the register of FIG. 
4. 

Detailed Description of the Preferred Embodiments(s) 

35 [0008] Generally, the present invention relates to 
multi-way cache apparatus and methods of using multi- 
way cache. In accordance with a first aspect of the 
present invention, the apparatus is an apparatus having 
a multi-way cache. The apparatus includes a first user 

40 controllable element having a predetermined first 
attribute corresponding to a first way of the multi-way 
cache; a second user controllable element having a pre- 
determined second attribute corresponding to a second 
way of the multi-way cache; a conductor for transferring 

45 an access attribute to the multi-way cache; first com- 
pare circuitry which compares the access attribute to 
the predetermined first attribute to provide a first com- 
parison result; second compare circuitry which com- 
pares the access attribute to the predetermined second 

so attribute to provide a second comparison result; first 
way control circuitry for selectively enabling the first way 
of the multi-way cache based on the first comparison 
result; and second way control circuitry for selectively 
enabling the second way of the multi-way cache based 

55 on the second comparison result. 

[0009] In accordance with another aspect of the 
present invention, the apparatus is an integrated circuit. 
The integrated circuit includes a cache having a first 
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way and a second way; a first storage element for stor- 
ing a first stored attribute for the first way of the cache; a 
second storage element for storing a second stored 
attribute for the second way of the cache; a conductor 
for transferring an access attribute; and control circuitry. 5 
The control circuitry compares the access attribute to 
the first stored attribute to provide a first comparison 
result and selectively enables the first way of the cache 
based on the first comparison result. The control cir- 
cuitry also compares the access attribute to the second w 
stored attribute to provide a second comparison result 
and selectively enables the second way of the cache 
based on the second comparison result. 
[0010] In accordance with another aspect of the 
present invention, a method for operating a data is 
processing system having a multi-way cache is dis- 
closed. The method includes the steps of initiating an 
access operation; accessing the multi-way cache in 
response to the access operation; providing a provided 
access attribute to the multi-way cache as part of the 20 
access operation; comparing the provided access 
attribute with a first stored access attribute that corre- 
sponds to a first way of the multi-way cache; comparing 
the provided access attribute with a second stored 
access attribute that corresponds to a second way of 25 
the multi-way cache; selectively enabling the first way of 
the multi-way cache based on whether the provided 
access attribute matches the first stored access 
attribute; and selectively enabling the second way of the 
multi-way cache based on whether the provided access 30 
attribute matches the second stored access attribute. 
[001 1 ] It should be noted that the particular terms and 
expressions employed and the particular structural and 
operational details disclosed in the detailed description 
and accompanying drawings are for illustrative pur- 35 
poses only and are not intended to in any way limit the 
scope of the invention as described in the appended 
claims. 

[0012] Referring to FIG. 1, an embodiment of a 
processing system 1 0 is illustrated. The processing sys- 40 
tern 10 includes a processor 12, and an external mem- 
ory 14. The processor 12 includes a central processing 
unit 16, a cache memory 18, a bus interface 22, and 
other modules 20. The processor 12 also includes bus 
24 and bus 26. The bus 24 interconnects the CPU 16. 45 
the cache 18, the bus interface 22, and the other mod- 
ules 20. The bus 26 couples the bus interface 22 to the 
memory 14. While a specific exemplary embodiment of 
data processing system 10 has been disclosed, it is 
contemplated that various configurations and alterna- so 
tive embodiments of such a processing system could be 
implemented. For example, while the cache 18 has 
been shown as part of the processor 12, the cache 
could alternatively been disposed outside of the proces- 
sor 12, such as within the external memory 14. ss 
[0013] Referring to FIG. 2, a particular embodiment of 
a portion of the cache 1 8 is disclosed. The portion of the 
cache 18 includes a register 40, tag memory array for 



multiple ways 42-48, data memory array for multiple 
ways 50-56, and cache control circuitry 58. The cache 
control circuitry 58 includes register 80, comparator 60, 
and access control logic 82. The register 40 receives an 
address portion of the bus 24 and has a tag value por- 
tion 64, and index portion 66, and a word select portion 
68. The tag portion 64 includes tag value data that is 
provided to the multi-way tag array 42-48. Data from the 
index portion 66 is provided to both the multi-way tag 
array 42-48 and to the multi-way data array 50-56. Data 
from the word select portion 68 is provided to the multi- 
way data array 50-56. The multi-way data array is cou- 
pled to a bi-directional data portion of the bus 24. 
[0014] Each tag array, such as tag array (way 0) 42 
provides a hit signal to a corresponding data array, such 
as data array (way 0) 50 based on a comparison 
between tag value 64 and data located with respect to 
index value 66. The cache control circuitry 58 receives 
access attributes 87, address, and control data from 
bus 24. In an alternative embodiment, access attributes 
87 may be generated locally, such as from within the 
multi-way cache 18. The comparator 60 is used to com- 
pare the access attributes 87 with stored attribute val- 
ues from register 80 to produce a comparison result 61 
which is in turn processed by access control logic 82 to 
generate read enable signals 86 and write enable sig- 
nals 84 for each of the plurality of cache ways. Although 
only a single comparator 60 is illustrated, comparator 60 
includes a plurality of individual comparators for each of 
the plurality of cache ways. In a particular embodiment, 
the access attributes includes data class types for 
accessed information, such an instruction type or a data 
type of information stored in memory. The register 80 in 
this embodiment includes control bits corresponding to 
enable or disable for each of the data class types. In 
addition, the register 80 may include other control bits to 
select various functions enabled or disabled for each of 
the plurality of cache ways. An example of such addi- 
tional control bits is control bits to selectively enable 
cache flushing on a per way basis. In addition, the 
cache control circuitry communicates with the tag array 
42-48 and the data array 50-56 via respective communi- 
cation paths 62 and 70. 

[001 5] The cache control circuitry 58 is responsive to 
data received from the data bus 24. For example, a user 
programmable control word that contains user selected 
attribute control bits for a plurality of cache ways may be 
received from data bus 24 and stored in the register 80. 
In this manner, the register 80 may flexibly and dynami- 
cally allocate multi-way cache memory resources based 
on specific application or user needs. 
[0016] Referring to FIG. 3, a specific embodiment of a 
portion of first tag array way, such as the tag array (way 
0) 42 and a portion of a corresponding first data array 
way, such as the data array (way 0) 50 is illustrated. The 
above described portion includes the register 40 having 
the tag portion 64, index portion 66, and word select 
portion 68. The tag portion 64 is compared using com- 
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parator 65 with a value retrieved from the tag array (way 
0) 42 via index portion 66 to provide hit signal 72. The 
data array (way 0) 50 includes a plurality of data blocks 
and is addressed by both the index value 66 and the 
word select value 68. The addressed data item is output 
from the data array (way 0) 50 via a data bus which is a 
portion of bus 24. 

[0017] Also disclosed is way control circuitry 92 which 
receives read enable signals 86 and write enable sig- 
nals 84 at its input and provides a control signal 94 at its 
output. The control signal 94 includes read and write 
control signals for both the tag array (way 0) 42 and the 
data array (way 0) 50 as well as other associated control 
signals for functions to be performed or not performed 
on a per way basis. 

[0018] Referring to FIG. 4, a particular exemplary 
embodiment of register 80 within the cache control cir- 
cuitry 58 is illustrated. In this embodiment, the register 
80 includes a plurality of data fields, each field including 
a plurality of data bits. The register 80 includes a cache 
flush field 102, a data caching enable field 104, and an 
instruction caching enable field 106. Each of the fields 
102-106 may include one or more control bits. The 
cache control bits of field 102 are each associated with 
a different cache way. For each cache way, a particular 
cache control bit within field 102 will determine whether 
that particular cache way is flushed or cleared. When 
the particular cache way is flushed, all data within the 
data array for such way is invalidated. 
[0019] For each cache way, a particular cache control 
bit within field 104 will determine whether that particular 
cache way can be used to access data having a data 
class type. Similarly, for each cache way, a particular 
cache control bit within field 106 will determine whether 
that particular cache way can be used to access data 
having an instruction class type. While only the class 
types of data and instruction type have been disclosed, 
it is contemplated that the above per way method and 
structure is applicable to a variety of data classes. For 
example, other control fields may be used for alternate 
data class type definitions, such as a user class type, 
supervisor class type, stack data class type, and non- 
stack data class type. 

[0020] Referring to FIG. 5, a particular method of 
operating the data processing system 10 having a multi- 
way cache is illustrated. The method includes a first 
step, step 202, of initiating an access, such as a mem- 
ory access, where address and attribute information is 
provided to a multi-way cache. At step 204, the provided 
attribute information is compared to stored attribute 
control bits for each way of the multi-way cache. These 
stored attribute control bits may be the control bits 
stored in the register 80 as described above. Based on 
the above comparison, enable signals, such as read 
enable and write enable signals, are provided for each 
way of the multi-way cache, at step 206. Selected ways 
of the cache are enabled based on the enable signals 
while non-selected ways remain disabled., step 208. 



[0021] When accessing the cache, if there is a cache 
hit, step 210, the cache access continues with only the 
selected cache ways participating, step 212. In addition, 
a replacement function is used to determine a cache 

5 entry to be replaced in a subsequent replacement oper- 
ation. The replacement function is only affected by the 
selected ways of the multi-way cache. In the event of a 
cache miss, only the selected cache ways participate in 
a replacement operation, step 214. As a specific exam- 

10 pie, only the selected cache ways are available for 
replacement of existing blocks with the data block from 
external memory corresponding to the appropriate 
access operation. The access operation is then com- 
pleted, step 216. 

is [0022] The above multi-way cache apparatus and 
method has many benefits. For example, in certain 
processing applications, cache efficiency may be 
increased by providing higher allocation to certain data 
class types that are more often used by such applica- 
nt? tion. For example, in certain applications, a higher per- 
centage of instruction type data is accessed for 
processing and would therefore benefit from a higher 
cached usage. By allowing selective allocation of cache 
resources on a multi way basis, such preferred cache 

25 allocation can be allotted. In addition, since individual 
cache ways may be de-selected for particular data class 
types, power savings result from non-use of associated 
power consuming circuitry for the non-selected cache 
ways. Such conservation of power dissipation may be 

30 especially useful in many low power usage applications, 
such as in low power handled devices. 
[0023] Thus, there has been described herein an 
embodiment including at least one preferred embodi- 
ment of an improved multi -way cache apparatus and 

35 method of operating a data processing system. It will be 
apparent to those skilled in the art that the disclosed 
subject matter may be modified in numerous, ways and 
may assume many embodiments other than the pre- 
ferred form specifically set out and described above. 

40 Accordingly, the above disclosed subject matter is to be 
considered illustrative and not restrictive, and to the 
maximum extent allowed by law, it is intended by the 
appended claims to cover all such modifications and 
other embodiments which fall within the true spirit and 

45 scope of the present invention. The scope of the inven- 
tion is to be determined by the broadest permissible 
interpretation of the following claims and their equiva- 
lents rather than the foregoing detailed description. 

so Claims 

1 . A method for operating a data processing system 
having a multi-way cache, the method comprising 
the steps of: 

55 

initiating an access operation; 

accessing the multi-way cache in response to 
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the access operation; 

providing a provided access attribute to the 
multi-way cache as part of the access opera- 
tion; 5 

comparing the provided access attribute with a 
first stored access attribute that corresponds to 
a first way of the multi-way cache; 



comparing the provided access attribute with a 
second stored access attribute that corre- 
sponds to a second way of the multi-way 
cache; 

selectively enabling the first way of the multi- 
way cache based on whether the provided 
access attribute matches the first stored 
access attribute; and 

selectively enabling the second way of the 
multi-way cache based on whether the pro- 
vided access attribute matches the second 
stored access attribute. 

2. A method as in claim 1, wherein the provided 
access attribute, the first stored access attribute, 
and the second stored access attribute is each a 
supervisor/user attribute. 

3. A method as in claim 1 , further comprising steps of: 

determining if a cache miss has occurred dur- 
ing the access operation; and 

if the cache miss has occurred, performing a 
replacement operation using only ways of the 
multi-way cache that have been selectively 
enabled during the access operation. 

4. A method as in claim 1 wherein said step of selec- 
tively enabling the first way of the multi-way cache 
comprises steps of: 

selectively providing a first read enable signal 
to the first way of the multi-way cache; and 
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selectively providing a first write enable signal 7. 
to the first way of the multi-way cache. 

50 

5. A method as in claim 1 , further comprising steps of: 

providing a second provided access attribute to 

the multi-way cache as part of the access oper- 8. 

ation; 55 

comparing the second provided access 
attribute with a third stored access attribute that 



corresponds to the first way of the multi-way 
cache; 

comparing the second provided access 
attribute with a fourth stored access attribute 
that corresponds to the second way of the 
multi-way cache; 

selectively enabling the first way of the multi- 
way cache based on whether the provided 
access attribute matches the first stored 
access attribute and the second provided 
access attribute matches the third stored 
access attribute; and 

selectively enabling the second way of the 
multi-way cache based on whether the pro- 
vided access attribute matches the second 
stored access attribute and the second pro- 
vided access attribute matches the fourth 
stored access attribute. 

An integrated circuit, comprising: 

a cache having a first way and a second way; 

a first storage element for storing a first stored 
attribute for the first way of the cache; 

a second storage element for storing a second 
stored attribute for the second way of the 
cache; 

a conductor for transferring an access attribute; 
and 

control circuitry which compares the access 
attribute to the first stored attribute to provide a 
first comparison result and which selectively 
enables the first way of the cache based on the 
first comparison result, and which compares 
the access attribute to the second stored 
attribute to provide a second comparison result 
and which selectively enables the second way 
of the cache based on the second comparison 
result. 

An integrated circuit as in claim 6, wherein said first 
storage element comprises first user programma- 
ble register bits and wherein said second storage 
element comprises second user programmable 
register bits. 

An integrated circuit as in claim 6, wherein the first 
way of the cache comprises: 

a first tag portion; and 
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a first data portion; 

and wherein the second way of the cache com- 
prises: 

a second tag portion; and 5 
a second data portion. 

9. An integrated circuit as in claim 6, wherein the 
access attribute, the first stored attribute, and the io 
second stored attribute is each an instruction/data 
attribute. 

10. An apparatus having a multi-way cache, compris- 
ing: 15 

a first user controllable element having a pre- 
determined first attribute corresponding to a 
first way of the multi-way cache; 

20 

a second user controllable element having a 
predetermined second attribute corresponding 
to a second way of the multi-way cache; 

a conductor for transferring an access attribute 25 
to the multi-way cache; 

first compare circuitry which compares the 
access attribute to the predetermined first 
attribute to provide a first comparison result; 30 

second compare circuitry which compares the 
access attribute to the predetermined second 
attribute to provide a second comparison 
result; 35 

first way control circuitry for selectively ena- 
bling the first way of the multi-way cache based 
on the first comparison result; and 



second way control circuitry for selectively ena- 
bling the second way of the multi-way cache 
based on the second comparison result. 
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